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Abstract. A probabilistic structure on sequential dynamical systems is in- 
troduced here, the new model will be called Probabilistic Sequential Network, 
PSN. The morphisms of Probabilistic Sequential Networks are defined using 
two algebraic conditions. It is proved here that two homomorphic Probabilistic 
Sequential Networks have the same equilibrium or steady state probabilities if 
the morphism is either an epimorphism or a monomorphism. Additionally, the 
proof of the set of PSN with its morphisms form the category PSN, having 
the category of sequential dynamical systems SDS, as a full subcategory is 
given. Several examples of morphisms, subsystems and simulations are given. 

1. Introduction 

Probabilistic Boolean Networks was introduced by I. Schmulevich, E. Dougherty, 
and W. Zhang in 2000, for studying the dynamic of a network using time discrete 
Markov chains, see [14, 15, 17, 16]. This model had several applications in the 
study of cancer, see [18]. It is important for development an algebraic mathematical 
theory of the model Probabilistic Boolean Network PBN, to describe special maps 
between two PBN, called homomorphism and projection, the first papers in this 
direction are, [4, 6], b. Instead of this model is being used in applications, the 
connection of the graph of genes and the State Space is an interesting problem to 
study. The introduction of probabilities in the definition of Sequential Dynamical 
System has this objective. 

The theory of sequential dynamical systems (SDS) was born studying networks 
where the entities involved in the problem do not necessarily arrive at a place at 
the same time, and it is part of the theory of computer simulation, [2, 3]. The 
mathematical background for SDS was recently development by Laubenbacher and 
Pareigis, and it solves aspects of the theory and applications, see [8, 9, 10]. 

The introduction of a probabilistic structure on Sequential Dynamical Systems 
is an interesting problem that it is introduced in this paper. A SDS induces a 
finite dynamical system (fc",/), [5], but the mean difference between a SDS and 
FDS is that a SDS has a graph with information giving by the local functions, and 
an order in the sequential behavior of these local functions. It is known bi, that 
a finite dynamical systems can be studied as a SDS, because we can construct a 
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bilnformation giving by Laubenbacher. 



2 



MARIA A. AVINO-DIAZ 



bigger system that in this case is sequential. Making together the sequential order 
and the probabilistic structure in the dynamic of the system, the possibility to work 
in applications to genetics increase, because genes act in a sequential manner. In 
particular the notion of morphism in the category of SDS establishes connection 
between the digraph of genes and the State Space, that is the dynamic of the 
function. Working in the applications. Professor Dougherty's group wanted to 
consider two things in the definition of PBN: a sequential behavior on genes, and the 
exact definition of projective maps between two PBN that inherits the properties 
of the first digraph of genes. For this reason, a new model that considers both 
questions and tries to construct projections that work well is described here. I 
introduce in this paper the sequential behavior and the probability together in 
PSN and my final objective is to construct projective maps that let us reduce 
the number of functions in the finite dynamical systems inside the PBN. One of 
the mean problem in modeling dynamical systems is the computational aspect of 
the number of functions and the computation of steady states in the State Space. 
In particular, the reduction of number of functions is one of the most important 
problems, because by solving that we can determine which part of the network State 
Space may be simplified. The concept of morphism, simulation, epimorphism, and 
equivalent Probabilistic Sequential Networks are developed in this paper, with this 
particular objective. 

This paper is organized as follows. In section 2, a notation slightly different 
to the one used in [9] is introduced for homomorphisms of SDS. This notation is 
helpful for giving the concept of morphism of PSN. In section 3, the probabilistic 
structure on SDS is introduced using for each vertex of the support graph, a set of 
local functions, more than one schedule, and finally having several update functions 
with probabilities assigned to them. So, it is obtained a new concept: probabilistic 
sequential network (PSN). In Theorem 4.3 is proved that monomorphisms, and epi- 
morphisms of PSN have the same equilibrium or steady state probabilities. These 
strong results justify the introduction of the dynamical model PSN as an appli- 
cation to the study of sequential systems. In section 5, we prove that the PSN 
with its morphisms form the category PSN, having the category SDS as a full 
subcategory. Several examples of morphisms, subsystems and simulations are given 
in Section 6. 

2. Preliminaries 

In this introductory section we give the definitions and results of Sequential 
Dynamical System introduced by Laubenbacher and Pareigis in [9]. Let F be a 
graph, and let Vp = {1, . . . ,n} be the set of vertices of T. Let {ki\i € Vr) be a 
family of finite sets. The set ka are called the set of local states at a, for all a € Vr- 
Define fc" := fci X ■ • • X fc„ with \ki\ < oo, the set of (global) states of F. 
A Sequential Dynamical System (SDS) 

.F=(F,(fc,)?=i,(/0?=i.«) 

consists of 

1. A finite graph F = {Vr, Ep) with the set of vertices Vr = {1, . . . , n} , and 
the set of edges Er CVr xVr- 

2. A family of finite sets {ki\i G Vr). 
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3. A family of local functions fi : A:" ^ A:", that is 

where f{x\, . . . , x„) depends only of those variables which are connected to 
i in r. 

4. A permutation a = ( ai ... a„ ) in the set of vertices Vp, called an 
update schedule ( i.e. a bijective map a : Vr — > Vr). 

The global update function of the SDS is / = o . . . o /^^^ . The; function / 
defines the dynamical behavior of the SDS and determines a finite directed graph 
with vertex set fc" and directed edges (x,/(x)), for all x € A;", called the State 
Space of and denoted by 5/. 

The definition of homomorphism between two SDS uses the fact that the vertices 
Vr — {1, . . . , n} of a SDS and the states fc" together with their evaluation map fc" x 
Vr 9 {x,a) i-^< x, a >:= Xa S fc^, form a contravariant setup, so that morphisms 
between such structures should be defined contravariantly, i.e. by a pair of certain 
maps (f> -.r ^ A, and the induced function h^:k™^ k"" with the graph A having 
m vertices. Here we use a notation slightly different that the one using in [9]. 

Let F = (r, (/, : fc" ^ k"),a) and G = (A, (g, : fc™ ^ fc™),/3) be two SDS. 
Let : A ^ r be a digraph morphism. Let {(pi, : ^^(f,) ki),Wb £ A), be a 
family of maps in the category of Set. The map is an adjoint map, because is 
defined as follows: consider the pairing k" x Vp 3 {x, a) ^-^< x, a >:= Xa S ka', and 
similarly k"^ x Va 3 {y,b) t-^< y,b >:= yb G kb- The induced adjoint map holds 
< h^{x),b >:= (l>b{< x,(j){b) >) = <pb{X(t,{b))- Then (j), and (^b) induce the adjoint 
map hd, : k'" ^ fc™ defined as follows: 



h^{xi,. ..,Xn) = . ■ . , '/'m(a;^(m)))- 

G is a homomorphism of SDS if for all sets of orders Tjs associated 



(2.1) 

Then h : F 

to (3 in the connected components of A, the map holds the following conditions: 
(2.2) {gpi o gp^^^ o ■ ■ ■ o gp^) o = o 



where {/?;,/?;+!, . . . ,/3s} = ^{ai). If (j) ^(aj) = 0, then Jdfc™ o /i^ = /i^ o and 
the commutative diagram is now the following: 



fc" 1 k" 



(2.3) 



For examples and properties see[9]. It that paper, the authors proved that the 
above diagrams implies the following one 

/=/ai0...o/„ 



k" 



(2.4) 
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Probabilistic Boolean Networks [14, 15, 17, 18] The model Probabilistic Boolean 
Network A = A{T, F, C) is defined by the following: 

(1) a finite digraph F = (Vr, ^-r) with n vertices. 

(2) a family F = {Fi, F2, • • • , Fn} of ordered sets Fi = {fii,fi2, • • • , fii{i)} of 
functions fij : {0, 1}" — > {0, 1}, for i = 1, • • • , n, and j = 1,. . . , l{i) called 

predictors, 

(3) and a family C = {cij}ij, of selection probabilities. The selection proba- 
bility that the function fij is used for the vertex i is Cij . 

The dynamic of the model Probabilistic Boolean Network is given by the vector 
functions ffc = {fik^, f2k,, ■ ■ ■ , fnkj : {0,1}" ^ {0,1}" for 1 < h < l{i), and 
fiki G Fi, acting as a transition function. Each variable Xi G (0, 1} represents the 
state of the vertex i. All functions arc updated synchronously. At every time step, 
one of the functions is selected randomly from the set Fi according to a predefined 
probability distribution. The selection probability that the predictor fij is used to 
predict gene i is equal to 

= p{fiki = fij} = J2p^^= -fk}- 

ki=j 

There are two digraph structures associated with a Probabilistic Boolean Network: 
the low-level graph F, and the high-level graph which consists of the states of the 
system and the transitions between states. The state space S of the network to- 
gether with the set of network functions, in conjunction with transitions between 
the states and network functions, determine a Markov chain. The random per- 
turbation makes the Markov chain crgodic, meaning that it has the possibility of 
reaching any state from another state and that it possesses a long-run (steady-state) 
distribution. As a Genetic Regulatory Network (GRN), evolves in time, it will even- 
tually enter a fixed state, or a set of states, through which it will continue to cycle. 
In the first case the state is called a singleton or fixed point attractor, whereas, 
in the second case it is called a cyclic attractor. The attractors that the network 
may enter depend on the initial state. All initial states that eventually produce 
a given attractor constitute the basin of that attractor. The attractors represent 
the fixed points of the dynamical system that capture its long-term behavior. The 
number of transitions needed to return to a given state in an attractor is called the 
cycle length. Attractors may be used to characterize a cells phenotype (Kauffman, 
1993) [7]. The attractors of a Probabilistic Genetic Regulatory Network (PGRN) 
are the attractors of its constituent GRN. However, because a PGRN constitutes 
an ergodic Markov chain, its steady-state distribution plays a key role. Depending 
on the structure of a PGRN, its attractors may contain most of the steady-state 
probability mass [1, 12, 19]. 

3. Probabilistic Sequential Networks 

The following definition give us the possibility to have several update functions 
acting in a sequential manner with assigned probabilities. All these, permit us 
to study the dynamic of these systems using Markov chains and other probability 
tools. 

Definition 3.1. A Probabilistic Sequential Network (PSN) 

-D = (r, {Fjifir, {kX=^, iaj)%i,C = {ci, . . . , cj) 
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consists of: 

(1) a finite graph T = {Vr, Ep) with n vertices; 

(2) a family of finite sets {ka\a G Vr). 

(3) for each vertex aofVa set of local functions 

Fa = {fai:k^ ^k^\l<i<m}, 

is assigned, (i. e. there exists a bijection map Vr — > {.^a|l < d < ?^}^ 
(for definition of local function see (11.2)). 

(4) a family of m permutations a = { a\ ... an ) in the set of vertices Vr . 

(5) and a set C = {ci, . . . , Cg}, of assign probabilities to s update functions. 

We select one function in each set Fa, that is one for each vertices a of F, and 
a permutation a, with the order in which the vertex a is selected, so there are n 
possibly different update functions /j = faih o . . . o fa^i^, where n < n! x x 

• • • X £{n). The probabilities arc assigned to the update functions, so there exists a 
set S = {/i, . . . , fs} of selected update functions such that Ci — p{fi), 1 < i < s. 

Definition 3.2. The State Space ofV is a weighted digraph whose vertices are the 
elements of fc" and there is an arrow going from the vertex u to the vertex v if there 
exists an update function /, G S, such that v = fi{u). The probability p(u. v) of the 
arrow going from u to v is the sum of the probabilities cj^ of all functions fi, such 

that V — fi{u), u — ^ = V. We denote the State Space by S-p- 

For each one update function in S we have one SDS inside the PSN, so the State 
Space Sf is a subdigraph of S-p- When we take the whole set of update functions 
generated by the data, we will say that we have the full PSN. It is very clear that 
a SDS is a particular PSN, where we take one local function for each vertex, and 
one permutation. The dynamic of a PSN is described by Markov Chains of the 
transition matrix associated to the State Space. 

Example 3.3. Let V = (F; Fi, F2, F3; Za^; ai, 02; (c/Jf=i), be the following PSN: 
!• • 3 

(1) The graph F; \ | 

2 • 

(2) Let x= {xi,X2,X3) e {0, In this paper, we always consider the operations 
over the finite field Z2 = {0, 1}, but we use additionally the following notation 
xi = xi + 1. Then the sets of local functions from 'L2' — > 'L'^ are the following 

Fl = {fll{x) = {l,X2,X3)Ji2{x) = {x7i,X2,Xs))} 
F2 = {.f2lix) = {xi,XiX2,X3)} 

F3 = {f3i{x) = (a;i,X2,a:ia;2),/32(a;) = (xi, 2:2, a;ia;2 + X3)} 

(3) The schedules or permutations are ai — 3 2 1);q;2 = (1 2 3). We 
obtain the following table of functions, and we select all of them for T> because the 
probabilities given by C. 

fl = /31 o /21 o /ii /2 = /ii o /21 ° /31 

fs = /32 O /2I O /ll .fi = /ll o /2I o /32 
/s = /3I O /2I O fi2 /e = /l2 O /21 O /31 
/? = /32 O /2I O /l2 fs = fl2 ° /2I O /32 
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The update functions are the following: 

fi{x) = {l,X2,X2) f2{x) = (l,a;ia;2,a;ia;2) 

f^ix) = (l,a;2,a;2 + .Es) f4{x) = (1, a;ia;2, a;ia;2 + xs) 

fsix) = {xi,xiX2, {xi + l)x2) feix) = (xi,a;ia::2,a;i2:2) 

frix) = {xi, {Xi + 1)X2, {Xi + 1)X2 + X3) fsix) = {xx,XxX2,XxX2 + 2:3) 

(4) The probabilities assigned are the following: cj^ = .18;c/2 = ■12;c/3 = -18; c/^ = 
.12; c/, = .12; c/, = .08; c/, = .12; c/, = .08. 

Example 3.4. We notice that there are several PSN that we can construct with 
the same initial data of functions and permutations, but with different set of prob- 
abilities, that is, subsystems ofV. For example if S' — {/i, /2, /s, A}, Fi — {fu}, 
and D = {df, = .355, rf/^ = .211, d/3 = .18, rf/^ = .254}, then 

B = (r; Fi, F2, Fr, Z2^ ai, a2; D = {.355, .211, .18, .254}), 

is a PSN too. 

4. MoRPHisMS OF Probabilistic Sequential Networks 

The definition of morphism of PSN is a natural extension of the concept of 

homomorphism of SDS. In this section we prove in Theorem 4.2 a strong property, 
that is the distribution of probabihties of two homomorphic PSN are enough close 
to prove Theorem 4.3. 

Consider the following two PSN Di = (F, {Fa)^^ii", {ka)a=i, {01^)3, Q and 

V2 = (A, (G6)it'r", ikb)r=i, {P^)3:D). We denote by S, the set of update functions 
of Vi, i = 1,2; and the following notation for (u, w) G fc" x fc", and (w, z) G fc™ x k"^, 

Cf{u,v) I Q otherwise j'^9y^'^>> \ otherwise J 
where p{h) is the probability of the function h. 

Definition 4.1. (Homomorphisms of PSN) A morphism h : Vi ^ consist of: 

(1) A graph morphism (/) : A — > F, and a family of maps in the category Set, 
{<j)b : k^(b) ~^ kb^b € A), that induces the adjoint function h^, see (2.1). 

(2) The induced adjoint map : fc" ^ fc™ holds that for all update functions 
f in Si there exists an update function g G ^2 such that h is a SDS- 
morphism from (F, (/ : fc" fc"),aj) to (A, {g : fc™ k"'),(3j). That is, 
the diagrams 2.2, 2.3, and 2.4 commute for all f and its selected g. 

(4-1) 

The second condition induces a map from to S2, that is /x(/) = g ii the 
selected function for / is g. We say that a morphism h from T>i to I>2 is a PSN- 
isomorphism if (/>, h^, and /i are bijcctivc functions, and d{h^{u),h0{g{u)) = 
c(w, f{u)) for all u, in fc", and all / G ^i, and all g G S2. We denote it by Vi = T>2. 

Special morphisms. Let D = (F, (Fi)^^i, {a^)jej,C) be a PSN. 
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Identity morphism. The functions <p — idr, — idk^, and /i = ids define the 
identity morphism T -.V and it is a trivial example of a PSN-isomorphism. 

MoNOMORPHiSM A morphism h of PSN is a monomorphism if (j) is surjective, 
is injective, and for all /, and its associated g we have that dg < Cf. 

Epimorphism a morphism is an epimorphism if (j> is injective, is surjective, 
and for all /, and its associated g we have that dg > Cf. 

Remark If the morphism h is either a monomorphism or an epimorphism, then 
the function /x is not necessary injective, neither surjective. 

Some theorems 

Theorem 4.2. The morphism h : Vi T>2 induces the following probabilistic 
condition: 

For a fixed real number < e < 1, the map satisfies the following: 
(4.2) maxu,v\cf{u,v) - dg{h^{u),h4,{v))\ < e 

for all f in Si, and its selected g in S2, and all {u,v) G fc" x fc". 
Proof. Suppose <p, and satisfy the Definition 4.1; and 

\cf{u,v) - dg{h^{u),h4,{v))\ >1 
for some {u,v) E x k". Then we have one of the following cases 

1. Cf{u,v) = 1 and dg{h^{u),h,p{v)) = 0. It is impossible by condition (2) in 
definition 4.1. In fact, if we have an arrow going from u to v = f{u), then 
there exists an arrow going from h^{u) to h^{v) = g{h^{u)) by diagram 
4.1, and the probability dg{h,j){u), h^{v)) ^ 0. 

2. Cf{u,v) = 0, and dg{h^{u) , h^{v)) = 1. It is impossible because at least 
there exists one element vi G k", such that f{u) = vi G k" and Cf{u, vi) 7^ 
0, then dg{h^{u),h^{vi)) ^ too. Since the sum of probabilities of all 
arrow going up from h^{u) is equal 1, then dg{h^{u) , h^{v)) < 1, and our 
claim holds. 

Therefore the condition holds, and always e exists. □ 

In the next theorem we will use the following notation: 

(1) = 

(2) g* = gogo---og,t times. 

(3) pt{u,v) = J2ftCft{u,v), and pt{h^{u),h^(v)) = Y,gt dgt{h^{u),h^{v)) 

(4) Ti denotes the transition matrix of Vi, for ?' = 1, 2, and pt{u, v) = {Ti^){u.v)- 

Theorem 4.3. If h :Vi — > I>2 is either a monomorphism or an epimorphism of 
probabilistic sequential networks, then: 

^hm |(Ti)?.,,-(T2)l^(„),,^(„)|=0, 
for all {u,v) & k"' X k". That is, the equilibrium state of both systems are equals. 

Proof. The condition giving by Theorem 4.2 asserts that, there exists a fixed real 
number < e < 1, such that the map satisfies the following: 

max„,„|c/(u,?;) - dg{(j){u),<p{v))\ < e 

for all / in Si, and its selected g in 6*2, and all {u, u) G A;" x fc". 

If there is a function / going from u to v = f{u) in fc", then there exists a 
function g going from h^{u) to h^{v), such that g{h^{u)) = h^{f{u)). 
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Because Cf2{u,p{u)) = Cf{u, f{u))cf{f{u), p{u)) =Cf'^, and 
dg2{h^{u), {h^{u))) = dg{h^{u),g{h^{u)))dg{g{h^{u)),g^(h^{u))) = dg^ . 
We have 

\cp{u,f{u)) - dg.{h^{u),g\h.,{u)))\ = |c/2 - d/l 
If ft is a monomorphism, then c/ > dg, for all / and its associated g. Then 

\cp{u, f{u)) - dg2{h4,{u),g'^{h4,{u)))\ = \cf'^ - dg^\ < Cf'^. 
By induction we have that 

|c/*(«, /*(«)) - dgt{h^{u),g\h^{u)))\ = \c/ -dg'\< c/. 
This result implies that 

\pt{u, v) - pt{K{u), h^{v))\ < ^ c/* + 5\u, v) 

/* 

where 5\u,v) = Eg6G(« '^s*' ^-^^^ = {g & G\g{h^{u)) = h^{v), and g ^ 

nsi)}. 

Then, when t goes to infinity the sum '^ft c/* + d^{u,v) goes to 0, and the 
theorem holds. If h is an epimorphism we obtain the same results, so the theorem 
holds again. 

□ 

5. The category PSN 

In this section, we prove that the PSN with the morphisms form a category, that 
we denote by PSN. For definitions, and results in Categories see [11]. 

Theorem 5.1. Let hi = {4>i,hrf,^) : Vi ^ V2 and = {4>2,h^2) : f 2 — >■ 2^3 be 
two morphisms of PSN. Then the composition h = {(j), h^) = {^2, h^^) ° {^ij^^^) = 
h2 o hi : Vi ^ is defined as follows: h — {(j),h^) = {(pi o (f)2,htf,^ o /i^J is a 
morphism of PSN. The function jiu = IJ'h2 ° M/ii • 

Proof. The composite function (j) = (j)i o (j)2 oi two graph morphisms is again a graph 
morphism. The composite function ft,^ = h^^ o h^^ is again a digraph morphism 
which satisfies the conditions in Definition 4.1, by Proposition and Definition 2.7 
in [9]. So, h = {(j), h^) is again a morphism. of PSN. □ 

Theorem 5.2. The Probability Sequential Networks together with the homomor- 
phisms of PSN form the category PSN. 

Proof. Easily follows from Theorem 5.1. □ 

Theorem 5.3. The SDS together with the morphisms defined in [9] form a full 
subcategory of the category PSN. 



Proof. It is trivial. 



□ 
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6. Simulation and examples 

In this section we give several examples of morphisms, and simulations. In the 
second example we show how the Definition 4.1 is verified under the supposition 
that a function (j) is defined. So, we have two examples in (6.2), one with (/> the 
natural inclusion, and the second with (j) a surjective map. The third, and the 
fourth examples are morphisms that represent simulation of Q by J^. We begin this 
section with the definitions of Simulation and sub-PSN. 

Definition of Simulation in the category PSN. The probabilistic sequen- 
tial network Q is simulated by if there exists a monomorphism /i : .F — > ^ or an 
epimorphism h! -.Q ^ T. 

Sub Probabilistic Sequential Network We say that a PSN ^ is a sub Prob- 
abilistic Sequential Network of T if there exists a monomorphism from Q to T . If 
the map is not a bijection, then we say that it is a proper sub-PSN. 



6.1. Examples. 

(6.1.1) In the examples 3.3, and 3.4 we define two PSN T> and B. The fimctions 
(/> = Idr, /i0 = /(ifen, and \x the natural inclusion from S\ to 5*2 define the inclusion 
in : B ^ T>. It is clear that the inclusion is a monomorphism, so V is simulated by 
B. 

(6.1.2) Consider the two graphs below 

2» #3 2» #3 

F I I and A I 

1» .4 1» 

Suppose that the functions associated to the vertices are the famihes {/i, /2, /s, .A}, 
for r and {§1,92,93} for A. The permutations are ai = (4 3 2 1), 0:2 = (4 1 3 2) 
and /?! = (3 2 1), P2 = {1 3 2), so, S = {f = Uo f-^o f^o f.-J^ f,o f^o f^o f^}, 
and X = {g = gs o g2 o gi; g = gi o o (72}. Then, we have constructed two PSN, 
each one with two permutations and only one function associated to each vertex in 
the graph; denoted by: 

= (r;/i,/2,/3,/4;ai,a2;C) and B = (A; gi, 52, 53; /?2; £>)■ 

Case (a) We assume that there exists a morphism h : V ^ B, with the graph 
morphism : A — > F giving by 4'{\) — 1, (j){2) = 2, (j){2>) = 3. Suppose the 
functions 

(^6 : fc^(6) ^ fc6,V6 e A), 
are giving, and the adjoint function 

h^:k'^—>- k^, h^{xi,X2,X3,X4) = ((^i(a;i), ^2(2:2), <^3(a;3)) 

is defined too. If /i is a morphism, which satisfies the definition (4.1), then the 
following diagrams commute: 

hi fi' , 1.4 -^3 ■ T.A , 1.4 . 1.4 

fc^J^ 

i-3 ■'"'^ 1 1.3 g3 ,3 g2 ,3 31 , 1.3 



10 



MARIA A. AVINO-DIAZ 

fi 7 4 fs , 



Id 



fc3 



^k' fc3 ^ 

Case (b) Consider now the map c/i : F ^ A, defined by 01 
(/'(3) — 3, and 0(4) = 3. If there exists a morphism h : B 
Definition 4.1, then 



1) = 1, 0(2) = 2, 
V that satisfies 



fc3 



93 



fc3 



32 



fc4 

fc3 



/40/3 



h 



k^ 



/40/3 



fc3 



91 



•1 

k^ 



fc3 



fc3 
fc3 



fc3 



(6.1.3) We now construct a monomorphism h : T ^ Q, with the properties that 
is surjective and the function is injective. The PSN = (F, {Fi)3,f3,C) has 
the support graph F with three vertices, and the PSN G = (A, (G,)4, a, D) has the 
support graph A with four vertices 

• 3 2 • .4 

F I A \ I 
!• .2 !• .3 

The morphism h : T ^ Q, has the contravariant graph morphism </> : A ^ F, 
defined by the arrows of graphs, as follows 0(1) = 1, 0(2) = 0(3) = 2, and 0(4) = 3, 

so it is a surjective map. The family of functions 0i : k^i) k(^i-^, (f>i(xi) — xi; 

02 (2^2) = ^2] 03 ('^2 ) = ^2] 04(2^4) = X4, are injective functions. The sets fc^ = Z2, 
for all vertices a in A. and F. The adjoint function is hff, : Z2'' defined by 

hft,{xi,X2,X3) = (01 (xi), 02(2:2), 03(a;2), 04(2:4)) = (2:1, 0:2, 2:2, 2:3). 

Then, the first condition in the definition 4.1 holds. 

The PSN = ( F; (F,)3; C), is defined with the following data. 
The set of functions Fi = { /n, /12)}, F2 = {/21}, and F3 = {/31}, where 

fit = Id, 712(2:1, 2:2, 0:3) (1,2:2, 0:3), f2i=Id, 

/s 1(2:1,. 1:2, .^3) = ixi,X2,X2X^). 

A permutation /? = ( 1 2 3 ); and the probabilities C = {c/j = .5168, c/2 = .4832}. 
So, we are taking all the update functions S = {/i, /2}; 

/i = /ii 0/21 0/31, /i = (a;i,a;2,X3) = {xi,X2,X2X^); 

and /2 = /12 o /21 o /31, /2(a;i, 2:2, 2:3) = (1,0:2, a;2S3)- 
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On the other hand, the PSN Q = (A; (Gi)4; a; D) has the foUowing data. 
The famihes of functions: G\ = {511,512}; G2 = {521,522}, G3 = {531,532}; and 
G4 = {54}, where 



gii{xi,X2,x:i,X4) 

g2lixi,X2,X3,X4) 

53i(a;i,a;2,a;3,a;4) 
541 (a;i,a;2,a;3,a;4) 



(l,a::2,a;3,a;4) 
(xi, l,a;3,a;4) 
(a;i,a;2,a;ia;2,a;4) 
(a;i,a;2,a;3, 2:234) 



512 ^ Id = 522 

532(2:1, a;2,a;3, 0:4) =(2:1,0:2,2:2,2:4) 



One permutation or schedule «=(! 2 3 4). The assigned probabihties 



.00252, dg 



.08321, dg^ = .51428, dg 



.39999 whose determine the set 



of update functions X = {95,96,97,98}' therefore the all update functions are the 
following 



52 = 512 o 521 o 532 o 541 
55 = 512 0522 0531 0541, 
58 = 511 ° 522 o 532 o 541 



53 = 512 0521 0531 0541, 
56 = 511 ° 522 o 531 o 541 



51 = 511 °52i 0531 0541, 
54 = 511 ° 521 ° 532 o 541 
57 = 512 0522 0532 0541, 

The selected functions are 

55(2:1, 2:2, 2:3, 2:4) = (2:1, 2:2, 2:12:2, 2:2x1), 55(2:1,2:2,2:3,2:4) = (1,2:2,2:1X2,2:2x1) 

57(2:1, X2, X3, X4) = (Xi, X2, X2, X2Xj), 58(xi, X2, X3, X4) = (1, X2, X2, X2Xj) 

We claim that /i : .F — > ^ is a morphism, in fact the following diagrams commute. 



and 



Z2 



In fact, (/i0 o /i)(xi,X2,X3) = (xi, X2, X2,X2x5') = (57 o /i0)(xi,X2,X3), on the 
other hand {h^ o /2)(xi, X2, X3) = (1, X2, X2, X2Xi) = (53 o /i0)(xi, X2, X3) so, the 
property holds. We verify the second property in the definition of morphism for 
the compositions /i and 57, and also with the compositions /2 and 9s- That is, we 
check the sequence of local functions too. 

rn 3 r,7 3 hi rff 3 /n n7 3 



Z2^ 



'4 



/31 



* Z2* 

> Z2^ 

> Z2^ 



S220932 



Z2* 

Z23 

3220332 ™ 4 

> il(2 



Zo 



Za^ 



(/i<;i O /3l)(2:i,X2,X3) = (xi,X2,X2,X2X3) = (54I O /l^) (xi , X2 , X3 ) , 

(/l,/. O /2l)(2;i,X2,X3) = (X1,X2,X2,X3) = ((522 O 532) O /l^)(xi, X2, X3), 

(^0 O /ll)(xi,X2,X3) = (xi,X2,X2,X3) = (512 O /l^) (xi , X2 , X3) , 

(/l^i O /i2)(xi,X2,X3) = (1,X2,X2,X3) = (511 O /l^) (xi , X2 , X3) 

The probabilities satisfy the following conditions: p{fi) > pigr), and p{f2) > Pigs)- 
Then our claim holds, and is a monomorphism. 

(6.1.4) We can construct an epimorphism h' : Q ^ J^, that is, the function (j) is 
injective and the function h'^ is surjective. We use ^' : F ^ A, defined as follow 
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<f)'{i) = i + 1, for all i £ Vr- Therefore (j)' ^ : k^i(^i) ki^i), (j)' ^ : Z2 Z2, for all 
i G Vr, and should be satisfies < h^{x),i >:= 4'b{< x,<p{i) >) = ^b{x4,(i))- So, the 
adjoint function is X2, 2:3, 2:4) = {^'i{xi),^'2{x3),^'3{x3)) = (a;i, a;2, a;4)and 

satisfies the following commutative diagrams 

Z2* Z2^ Z2* Z2^ Z2^ Z2^ Z2* 

Z2^ > Z2^ Z2-^ > Z2^ Z2^ — ^ Za'"* Z2''' > Z: 

These implies that ^^(55) = /"(St) = /i, and fi{gg) ^ fi{g^) ^ In fact, 

(^^ o.95)(a;i,a;2,a::3,2:4) = (a^i, 2:2, a;2Xl) = (/i o /i^)(a;i, 2:2, 2:3, a:;4), 

(^0 og6)(2;i,X2,2;3,2;4) = (1,2;2,2:22:"4) = (/2 O /l'^)(xi,X2,X3,2;4), 

(^^ ° 57) (2^1, 2:2, 2:3, 2:4) = (xi,2;2,a;2xl) = (/i o /i^)(a;i, 2:2, 2:3, 2:4), 

°5'8)(2;i,2;2,X3,X4) = (1,X2,X2X4) = (/2 O /l'^) (2;i , X2, 2:3, 2:4). 

Checking the compositions of local functions 55 = 512 o 522 ° 331 ° 541, and 
/i = /ii o /21 o /31, we have that the following diagrams commute 

4 912 4 S22 ,-5, 4 S31 ,-7, 4 r?? 4 

^2 > ^2 * '^-'2 * ^2 > '^-'2 



h' 



h' 



h' 



Z2'' Za^"* Za^ Z2^'' Z2 

By the data we only need to check the following compositions 

^^(53l(2;i,2;2,X3,X4)) = (Xi, 2:2, 2:4) = /2l(/l0(2;i,2;2,X3,2:4)), 

/i^(S'4i(2;i,2;2,2;3,2;4)) = (xi, 2:2, 2:2X4) = /3i(/i0(2;i, X2, X3, X4)). Similarly, we can 
prove that the other functions hold the property. The probabilities satisfy the 
following conditions: p{gr,) < p{fi),p{g7) < p(/i),p(ff6) < p{f2), and p{gs) < p{h)- 
Therefore h'^ is an epimorphism. 

7. Equivalent Probabilistic Sequential Networks 

Definition 7.1. (Equivalent PSN) // the morphism h : Vi ^ T>2 satisfies that <p, 

hff, and fx are bijective functions, but the probabilities are not necessary equals, we 
say that Vi, and T>2 are equivalent PSN. We write T>i ~ Pa- 

So, 2?i, and 2?2 arc equivalents if there exist (0, h^, /x), and {(t>~'^ , h^^ , fJ,"^), such 
that for all update functions / S Pi and its selected function g &T>2, the condition 
f = h^^ o g o h^ holds . It is clear that this relation is an equivalence relation in 
the set of PSN. 

Proposition 7.2. // Vi ~ V2, then the transition matrices Ti and T2 satisfy: 
{Tr){u,v) ^ 0, if and only if {T^)ih,{u),h,{v)) 0, for all m e N, {u,v) G fc" x fc". 

Proof. It is obvious. □ 
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